Crate fastcdc

This crate implements the “FastCDC” content defined chunking algorithm in pure Rust. A critical aspect of its behavior is that it returns exactly the same results for the same input. To learn more about content defined chunking and its applications, see “FastCDC: a Fast and Efficient Content-Defined Chunking Approach for Data Deduplication” (paper and presentation)

See the FastCDC struct for basic usage and an example.

For a slightly more involved example, see the examples directory in the source repository.

Structs

Chunk

Represents a chunk, returned from the FastCDC iterator.

FastCDC

The FastCDC chunker implementation. Use new to construct a new instance, and then iterate over the Chunks via the Iterator trait.

Constants

AVERAGE_MAX

Largest acceptable value for the average chunk size.

AVERAGE_MIN

Smallest acceptable value for the average chunk size.

MAXIMUM_MAX

Largest acceptable value for the maximum chunk size.

MAXIMUM_MIN

Smallest acceptable value for the maximum chunk size.

MINIMUM_MAX

Largest acceptable value for the minimum chunk size.

MINIMUM_MIN

Smallest acceptable value for the minimum chunk size.